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EXECUTIVE  SUMMARY 

This  test  report  presents  the  results  of  the  Boundary  Avoidanee  Tracking  (BAT)  Test 
Management  Project  (TMP).  The  HAVE  BAT  TMP  was  conducted  at  the  request  of  the  Air 
Force  Test  Pilot  School  in  collaboration  with  the  Air  Force  Institute  of  Technology  (AFIT), 
Wright  Patterson  AFB,  OH.  The  project  logged  approximately  23.7  hours  over  10  flight  test 
missions  in  the  R-2508  complex  during  April  and  May  2006  to  accomplish  the  test  objectives. 

HAVE  BAT  was  the  first  flight  test  exploring  the  phenomenon  of  boundary  tracking. 
Boundary  tracking  occurs  when  a  pilot  perceives  an  impending  hazardous  situation  and  abandons 
other  tasks  to  avoid  the  hazard  (or  boundary).  When  the  pilot  is  confined  between  opposing 
boundaries,  divergent  oscillations  akin  to  pilot-in-the-loop  oscillations  (PIO)  have  occurred.  The 
purpose  of  the  HAVE  BAT  test  program  was  to  determine  the  relationship  between  longitudinal 
characteristics  of  an  airborne  system  consisting  of  the  pilot  and  the  aircraft,  and  the  characteristic 
parameters  of  the  boundary  avoidance  tracking  events.  The  HAVE  BAT  TMP  had  three  primary 
objectives:  (1)  determine  the  system  open-loop  characteristics;  (2)  determine  the  values  of 
selected  parameters  that  characterize  the  boundary  avoidance  tracking;  and  (3)  determine  the 
degree  of  correlation  between  the  system  open-loop  characteristics  and  the  boundary  avoidance 
tracking  parameters.  The  first  objective  was  met;  however  the  other  objectives  were  only 
partially  satisfied.  However,  the  test  team  did  find  PIO  attributable  to  the  imposed  boundaries. 
Conversely,  no  PIO  were  experienced  when  boundaries  were  not  imposed.  Even  though  not  all 
of  the  objectives  were  met,  the  qualitative  connection  between  boundaries  and  PIO  warrants 
further  flight  testing  and  continued  analysis  of  current  flight  test  data. 

HAVE  BAT  flight  testing  pursued  the  open-loop  characteristics  of  the  system  (the  pilot 
plus  the  aircraft)  and  the  closed-loop  boundary  avoidance  tracking  parameters  thought  to 
characterize  boundary  avoidance  tracking.  The  open-loop  characteristics  were  system  time  delay 
and  longitudinal  stick  frequencies  during  out-of-phase  aircraft  motion.  The  boundary  avoidance 
tracking  parameters  were:  times  to  the  boundaries,  feedback  gain,  and  times  at  which  the 
minimum  and  maximum  gain  were  employed.  The  test  flights  involved  a  formation  of  a  test  and 
target  aircraft.  Test-specific  markings  on  the  target  aircraft  served  as  boundaries  to  limit  the 
vertical  deviation  from  the  formation  position.  To  induce  boundary  avoidance  tracking,  the 
target  aircraft  maneuvered  in  pitch,  forcing  the  test  pilot  to  act  to  avoid  breaking  the  boundaries. 
The  open-loop  and  boundary  avoidance  tracking  parameters  were  then  compared  in  order  to 
determine  their  degree  of  correlation. 

Representative  test  runs  were  selected  at  varying  flight  conditions  and  boundary  avoidance 
parameters  were  estimated  using  a  previously  developed  simulator-validated  model.  While  the 
expected  boundary  tracking  behavior  was  observed  qualitatively,  direct  measurement  of  the 
boundary  parameters  from  the  time  series  data  was  not  possible  due  to  insufficient  sampling  rate 
and  a  dynamic  flight  environment.  These  parameters  were  therefore  estimated  using  a 
previously  developed  model  that  had  been  validated  during  simulator  testing.  Applying  this 
model  to  the  flight  test  data,  varying  degrees  of  correlation  between  the  open-loop  parameters 
and  boundary  avoidance  tracking  parameters  were  identified.  However,  due  to  lengthy  data 
reduction  timelines,  all  of  the  data  could  not  be  analyzed  within  the  project  timeline  and  the 
correlation  was  of  low  confidence.  Despite  that,  the  pilots’  comments  on  the  direct  influence  of 
the  boundaries  on  PIO  events  warrant  continued  data  analysis  and  further  flight  testing. 
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INTRODUCTION 

General 

The  HAVE  BAT  Test  Management  Project  (TMP)  was  one  of  a  series  of  investigations 
into  the  phenomenon  of  boundary  tracking.  Boundary  tracking  occurs  when  a  pilot  perceives  an 
impending  hazardous  situation  and  abandons  other  tasks  to  avoid  the  hazard.  The  goal  of  this 
research  was  to  determine  the  degree  of  correlation  between  specific  open-loop  characteristics  of 
the  pilot-aircraft  system  and  selected  parameters  that  represent  boundary  tracking  during  various 
longitudinal  tracking  tasks.  Establishing  a  relationship  could  lead  to  a  better  understanding  and 
characterization  of  the  boundary  tracking  phenomenon  and  could  potentially  lead  to  better 
predictions  of  aircraft  PIO  susceptibility.  HAVE  BAT  was  the  first  known  effort  to  investigate 
and  quantify  boundary  tracking  in  flight. 

This  technical  report  presents  the  findings  of  the  HAVE  BAT  Test  Team  from  the  USAE 
Test  Pilot  School  (TPS)  at  Edwards  AEB,  CA.  The  HAVE  BAT  TMP  was  conducted  at  the 
request  of  the  Air  Eorce  Test  Pilot  School  in  collaboration  with  the  Air  Eorce  Institute  of 
Technology  (AEIT),  Wright  Patterson  APB,  OH.  The  Commandant  of  USAE  TPS  directed  this 
program.  All  testing  was  accomplished  under  TPS  Job  Order  Number  (JON)  M06TMP00.  The 
flight  test  program  consisted  of  ten  test  flights,  each  with  both  a  test  T-38C  and  a  target  T-38A 
aircraft.  A  third  T-38A  aircraft  carried  a  professional  photographer  and  served  as  photo  chase 
during  the  last  test  flight.  Total  flight  time  for  the  21  sorties  was  23.7  flight  hours.  Simulator 
preparation  was  conducted  at  the  Air  Eorce  Research  Eaboratories  (APRL),  Wright-Patterson  Air 
Eorce  Base,  Ohio  (See  appendix  B).  All  flight  testing  was  accomplished  within  the  R-2508 
complex  at  Edwards  Air  Eorce  Base,  California. 

Background 

Boundary  tracking  was  first  described  by  Mr.  William  Gray  in  a  paper  presented  to  the 
Society  of  Experimental  Test  Pilots  (SETP)  (reference  1,2).  Observations  into  tracking  tasks, 
traditionally  thought  as  striving  to  maintain  a  certain  condition,  revealed  that  sometimes  a 
tracking  task  included  trying  to  avoid  a  condition.  Anecdotal  accounts  seemed  to  support  this  in 
that  pilots  were  often  found  to  control  an  aircraft  in  order  to  avoid  a  hazardous  situation  or 
operational  limit.  These  thoughts  led  to  the  theory  of  boundary  avoidance  tracking.  Boundary 
avoidance  tracking  was  to  prevent  or  minimize  crossing  a  boundary.  There  was  not  a  tracking 
point  to  get  towards,  but  rather  a  boundary  to  track  away  from,  or  avoid.  This  was  a  fundamental 
difference  from  traditional  tracking  tasks. 

Another  fundamental  difference  included  the  size  of  control  inputs  during  traditional 
tracking  tasks  compared  to  those  during  boundary  avoidance  tracking.  Tracking  to  a  certain 
point,  the  control  inputs  are  smaller  while  the  pilot  is  trying  to  maintain  a  track  point.  Only  when 
the  pilot  deviates  far  from  the  intended  track  point  do  the  control  inputs  increase  in  order  to  get 
back  to  the  track  point.  Conversely,  during  boundary  avoidance  tracking,  control  inputs  increase 
as  boundaries,  the  things  being  tracked,  become  more  of  a  threat.  When  the  boundaries  then 
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become  less  of  a  threat,  the  control  inputs  get  smaller.  It  was  even  possible  to  consider  a  time 
where  the  boundaries  were  never  a  concern  and  the  pilot  could  continue  onto  another  task. 

This  highlighted  another  difference  between  traditional  tracking  and  boundary  avoidance 
tracking.  Point  tracking  is  strived  to  be  maintained,  boundary  avoidance  tracking  only  comes  in 
to  play  once  the  boundaries  become  a  threat.  Once  they  do  become  a  threat,  the  pilot  could 
abandon  the  point  tracking  task  and  move  to  boundary  avoidance  tracking.  Then  if  the 
boundaries  stopped  being  a  threat  the  boundary  avoidance  tracking  would  be  abandoned  and 
point  tracking  would  then  be  resumed. 

Mr.  Gray’s  original  simulation  revealed  that  the  application  of  sufficiently  tight  boundaries 
to  a  point  tracking  task  results  in  coupled  pilot- aircraft  oscillations  between  the  boundaries. 
These  events  of  boundary  avoidance  tracking  were  characterized  by  the  time-to-boundary  -  a 
function  of  the  distance  to  the  boundary  and  the  rate  at  which  the  boundary  was  approached. 

Two  primary  times-to-boundary  were  found  to  be  descriptors  of  boundary  avoidance 
tracking  during  Mr.  Gray’s  original  simulation.  Boundary  awareness  was  defined  as  the  time-to- 
boundary  at  which  minimal  control  input  was  used  by  the  tracker  to  avoid  a  boundary;  this 
parameter  was  named  “tmin”  relating  to  the  minimal  feedback  used.  Boundary  avoidance  was 
defined  as  the  time-to-boundary  at  which  maximum  feedback  was  used  by  the  tracker  to  avoid 
the  rapidly  approaching  boundary.  This  parameter  was  named  “tmax”  referencing  the  application 
of  maximum  feedback  at  the  specified  time-to-boundary.  Boundary  tracking  occurs  when  the 
time-to-boundary  is  less  than  tmin  and  maximum  pilot  response  occurs  at  times  less  than  tmax- 

The  next  iteration  of  the  boundary  tracking  theory  conducted  by  Mr.  Gray  was  a  pilot-in- 
the-loop  simulation  (reference  1,2)  in  which  eight  test  subjects  were  provided  a  tracking  task 
where  boundary  distances  were  successively  decreased  throughout  the  simulation.  The  test 
subjects  were  to  minimize  altitude  differences  between  their  aircraft  and  the  lead  aircraft  while 
avoiding  the  ever-encroaching  boundaries.  Although  a  relatively  small  test  population  was  used, 
the  results  of  the  study  provided  fairly  well  correlated  mean  values  of  tmin  and  tmax  for  test 
subjects  with  highly  varied  flight  experience  (from  no  experience  to  thousands  of  fighter  flight 
hours).  This  study  showed  that  the  boundary  avoidance  tracking  parameters  for  a  specific  flying 
task  at  a  specific  flight  condition  were  fairly  constant  for  all  pilot  experience  levels.  Both  studies 
also  revealed  that  system  time  delay  had  a  significant  impact  on  the  time-to-boundary 
parameters. 

HAVE  BAT  took  the  next  step  by  investigating  boundary  avoidance  tracking  in  flight  for 
the  first  time,  varying  flight  conditions  (altitude,  airspeed,  and  configuration)  to  examine  how  the 
change  in  system  characteristics  affected  the  boundary  avoidance  tracking  behavior.  Future 
projects  are  scheduled  to  further  analyze  the  data  and  build  upon  the  results  of  HAVE  BAT, 
including  graduate  research  theses  by  two  AFIT  graduate  students  and  additional  flight  test 
programs  at  the  USAF  Test  Pilot  School. 

Program  Chronology 

A  joint  Technical  Review  Board/Safety  Review  Board  (TRB/SRB)  was  held  on  24  March 
2006.  The  TRB  was  chaired  by  the  USAF  TPS  Education  Division  (USAF  TPS/ED),  and  the 
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SRB  was  chaired  by  the  AFFTC  Safety  Office  (AFFTC/SET).  The  HAVE  BAT  team  performed 
pre-test  simulator  preparation  at  the  AERL  simulators  on  Mareh  16-17,  2006.  Elight  testing  took 
plaee  from  10  April  to  4  May  2006. 

Test  Item  Description 

The  item  examined  by  HAVE  BAT  was  not  simply  an  object  or  device,  but  a  complex 
system  encompassing  both  an  aircraft  and  its  pilot.  The  system  eomprised  all  the  steps  between 
the  pilot’s  perception  of  an  impending  violation  of  a  boundary  and  the  resulting  movement  of  the 
aircraft.  Significant  parts  of  the  system  ineluded  the  pilot’s  eye,  brain,  and  hands,  the  aircraft 
control  stick’s  tactile  feedback  mechanisms,  the  flight  eontrol  system,  and  the  aircraft 
aerodynamics. 

The  human  component  was  the  most  difficult  portion  of  the  system  to  quantify.  Pilot 
stimuli  such  as  formation  position  references  and  oncoming  boundaries  were  captured  by  frame- 
by-frame  analysis  of  video  shot  from  cameras  positioned  as  close  to  the  pilot’s  perspective  as 
possible.  This  pilot’ s-eye  approaeh  was  fundamental  to  the  project  to  represent  the  human 
element  of  the  system  faithfully. 

The  T-38C  aireraft,  originally  produced  by  Northrop  Corporation,  Aireraft  Division  and 
upgraded  by  The  Boeing  Company,  was  a  two-place,  twin-turbojet  supersonic  trainer.  The 
aircraft  was  equipped  with  an  all-movable  horizontal  tail  and  a  hydraulieally  powered, 
irreversible  flight  eontrol  system.  Airloads  on  the  control  surfaces  cannot  cause  control  stick  or 
surface  movement,  so  conventional  aerodynamie  feel  in  the  eontrol  stick  was  provided 
artificially  by  springs  and  bobweights. 

Test  Objectives 

The  first  objective  was  to  determine  the  system  open-loop  charaeteristies.  The  open- loop 
characteristics  of  the  system  represented  the  nature  of  the  aireraft  response  to  pilot  inputs  at  that 
flight  eondition.  System  time  delay  was  the  time  from  stick  movement  until  vertical  movement 
of  the  aircraft  in  relation  to  a  target  aircraft  was  perceived  by  the  pilot.  The  system  crossover 
frequeney  was  the  rate  (cyeles/seeond)  at  whieh  the  pilot  could  oscillate  the  stick  fore  and  aft  and 
the  aireraft  would  move  vertieally  180  degrees  out  of  phase  with  the  stiek  deflection,  again  as 
perceived  by  the  pilot  in  relation  to  a  target  aircraft.  The  objeetive  was  met. 

The  second  objective  was  to  determine  boundary  avoidance  parameters  preceding  and 
during  a  boundary  avoidanee  event.  The  primary  boundary  avoidanee  parameters  selected  for 
the  study  were  the  time-to-boundary  when  the  pilot  first  responded  to  the  boundary  (Wn),  the 
time-to-boundary  when  the  pilot  made  the  maximum  stick  input  (tmax),  the  boundary  avoidance 
tracking  feedback  gain  (Kbm),  the  boundary  avoidance  tracking  parameter  (BTP  -  a  function  of 
train,  traax,  and  Kbm),  and  the  observed  pilot  actuation  frequency  (the  frequeney  of  identifiable, 
repeated  stiek  oscillations  during  the  task).  All  parameters  were  obtainable  by  inspection  of  the 
data  except  train,  so  Wn  was  estimated  using  a  model  that  had  not  been  validated  in  flight  test. 
Hence,  the  model  estimated  the  values  of  tmin  to  a  low  degree  of  confidenee  and  this  objective 
was  only  partially  met. 
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The  third  objective  was  to  determine  the  degrees  of  correlation  between  the  open-loop 
characteristics  and  the  boundary  avoidance  parameters  preceding  and  during  a  longitudinal 
boundary  avoidance  event.  Flight  conditions  were  varied  by  performing  the  flight  testing  at 
various  combinations  of  airspeed,  altitude,  and  configuration  (gear  extended  or  retracted).  The 
open-loop  characteristics  varied  at  the  different  flight  conditions  and  HAVE  BAT  investigated 
whether  the  boundary  avoidance  parameters  changed  accordingly.  While  correlations  were 
observed  to  varying  degrees,  the  statistical  significance  could  not  be  determined  because 
inadequate  camera  quality  precluded  automated  video  data  reduction  techniques  and  only  a 
portion  of  the  massive  volume  of  video  data  could  be  reduced.  This  objective  was  therefore 
partially  met  because  the  results  were  based  on  limited  test  points  and  qualitative  comments. 

Limitations 

Determination  of  a  key  boundary  tracking  parameter,  tmin,  was  not  possible  by  direct 
analysis  of  the  data  and  was  therefore  estimated  to  a  low  level  of  confidence  by  a  model.  As  a 
result,  the  objective  of  determining  the  key  boundary  tracking  parameters  was  only  partially  met. 

The  camera  provided  video  of  insufficient  quality  for  use  by  automated  video  data 
reduction  procedures  developed  by  the  HAVE  BAT  team.  The  backup  procedures  required  an 
analyst  to  manually  click  frame-by-frame  to  convert  the  video  data  to  numerical  data.  This 
manual  method  proved  excessively  time-consuming  and  to  meet  project  timelines  the  number  of 
closed-loop  test  points  analyzed  was  reduced  to  one  per  flight  condition.  Therefore,  while 
relationships  between  the  open-loop  parameters  and  closed-loop  results  were  investigated,  a 
rigorous  statistical  analysis  was  impractical  and  the  objective  was  only  partially  met. 
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TEST  AND  EVALUATION 

General 

HAVE  BAT  flight  testing  involved  a  test  aireraft  flying  in  preeise  formation  with  a  target 
aircraft  (see  figure  1).  Vertical  position  was  determined  by  visually  referencing  parts  of  the 
target  aircraft.  Test-specific  markings  on  the  target  aircraft  served  as  artificial  boundaries;  the 
pilot  of  the  test  aircraft  treated  the  crossing  the  boundaries  by  deviating  too  high  or  too  low  from 
the  formation  position  as  a  hazardous  event.  To  induce  boundary  avoidance  tracking  the  target 
aircraft  maneuvered  in  pitch,  forcing  the  test  pilot  to  act  quickly  to  avoid  breaking  the 
boundaries. 


Target  Aircraft  Markings  and  Configuration 

Two  T-38A  aircraft  were  marked  with  tape  and  decals  by  the  test  team  to  serve  as  target 
aircraft  as  shown  in  figure  2.  A  travel  pod  was  installed  on  the  scheduled  aircraft  to  provide 
additional  locations  for  boundary  markings.  The  red  and  yellow  circles  under  the  cockpit  and 
near  the  tail  served  as  color-unique  targets  for  use  by  automated  video  target-tracking  software. 
Black  horizontal  stripes  on  the  fuselage  and  on  the  travel  pod  served  as  the  artificial  boundaries 
when  imposed  upon  the  pilot. 
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Figure  2:  Target  Aircraft  Markings 


Pilot  Tasks  and  Mindset 

The  task  of  the  test  aireraft  pilot  was  simple;  fly  a  speeific  formation  position  off  the  target 
aireraft  by  traeking  referenee  markings  and  refuse  to  stray  beyond  imposed  boundaries.  The 
basic  formation  position  for  HAVE  BAT  flight  testing  approximated  a  route  position  with 
approximately  ten  foot  wingtip  spacing.  All  test  points  began  with  the  test  aircraft  performing 
the  “tracking  task”  of  maintaining  the  front  corner  of  the  wingtip  of  the  target  aircraft  level  with 
the  star  in  the  star-and-bars  USAF  insignia  on  the  fuselage  (see  figure  3).  The  pilot  continued 
the  tracking  task  throughout  the  test  point,  abandoning  it  only  when  boundary  penetration  was 
perceived  to  become  a  threat,  or  the  test  point  was  terminated  (if  the  tracking  task  could  be 
continued  without  any  boundary  avoidance  tracking  or  due  to  exceeding  the  databand). 
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To  recreate  faithfully  the  stress  of  a  pilot  who  perceives  an  oncoming  hazard,  the  HAVE 
BAT  pilots  flew  with  a  specific  mindset:  allowing  the  wingtip  to  deviate  beyond  the  imposed 
horizontal  boundary  markings  was  unacceptable.  Naturally,  the  experienced  HAVE  BAT  pilots 
would  limit  their  inputs  at  some  point  with  real  aircraft  limits  or  other  safety  considerations  in 
mind.  This  self-limiting  is  contained  the  boundary  avoidance  parameter  Kbm,  the  boundary 
avoidance  tracking  feedback  gain.  The  maximum  value  of  Kbm  was  essentially  any  self  limit  a 
pilot  puts  upon  stick  inputs.  Appendix  A  describes  the  development  of  the  boundary  avoidance 
parameters.  However,  the  experiments  were  designed  to  remove  or  reduce  the  risk  of  exceeding 
load  factor  limits  to  free  the  pilots  to  maneuver  without  restraint. 

Target  Maneuver  Profiles 

Prior  to  each  test  point,  the  target  aircraft  stabilized  in  straight  and  level,  unaccelerated 
flight  at  the  prescribed  flight  condition.  At  the  “begin  maneuver”  call  by  the  test  conductor,  the 
target  aircraft  remained  non-maneuvering  to  establish  baseline  data  for  the  test  aircraft  tracking 
performance.  Upon  reaching  the  pre -briefed  time,  the  target  aircraft  maneuvered  in  accordance 
with  one  of  the  following  profiles  as  directed  by  the  test  conductor.  The  throttles  were  not 
moved  in  the  target  aircraft  until  the  test  point  was  terminated. 

1)  STABEE  PEATEORM.  The  target  aircraft  maintained  the  initial  stable  flight  condition 
until  test  point  termination. 

2)  PUSH-OVER.  The  target  aircraft  pushed  over  at  0.5  g. 

3)  PULL-UP.  The  target  aircraft  pulled  up  at  2.0  g  (initial  airspeed  of  300  KIAS  or  greater) 
or  1.5g  (initial  airspeed  less  than  300  KIAS). 

4)  ROLLER-COASTER.  The  target  aircraft  smoothly  alternated  between  pushing  over  and 
pulling  up.  The  sequence  of  maneuvers  gradually  increased  in  magnitude,  and  then 
decreased  back  to  the  stable  1  g  flight  condition.  The  maximum  load  factor  swing  was 
between  0.5  g  and  1.5  g. 

The  element  of  surprise  in  boundary  avoidance  is  relevant  because  boundary  avoidance 
events  and  potentially  associated  pilot-in-the-loop  oscillations  require  a  trigger  (some 
unanticipated  event)  that  catches  the  pilot  by  surprise  and  causes  an  atypically  aggressive 
response.  To  include  the  effect  of  surprise,  the  pilot  of  the  test  aircraft  was  not  informed  which 
profile  the  target  aircraft  would  fly  for  the  test  point.  All  other  participants  were  briefed  to 
ensure  adequate  safety  planning  and  supervision. 

Test  points  were  terminated  when  the  target  aircraft  exited  the  databand  of  +  20  KIAS 
from  the  setup  airspeed  or  when  the  test  aircraft  exceeded  a  boundary. 

Test  Point  Design  and  Selection 

The  HAVE  BAT  experiment  was  designed  to  vary  the  system  open-loop  characteristics  so 
relationships  between  them  and  the  nature  of  ensuing  boundary  avoidance  events  could  be 
studied.  The  aerodynamic  effects  of  the  system  were  altered  by  performing  the  flight  test 
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techniques  at  different  altitudes,  airspeeds,  and  landing  gear  configurations  to  cause  the  desired 
open-loop  differences.  The  flaps  and  speed  brakes  were  not  extended  for  any  test  points. 
Table  1  lists  the  test  conditions  used  for  the  investigation.  A  comprehensive  breakdown  of  the 
test  flights  and  test  points  flown  is  provided  in  appendix  C. 


Table  1:  Flight  Conditions 


Flight  Condition 

Altitude 

(feet) 

Landing  Gear 
Position 

Airspeed 

(KIAS) 

Typical 

Mach 

Typical  Dynamic  Pressure,  q 
(pounds/square  foot) 

High  Fast  Cruise 

20,000 

Up 

375 

0.80 

477 

High  Slow  Cruise 

20,000 

Up 

250 

0.55 

212 

High  Configured 

20,000 

Down 

210 

0.46 

150 

Low  Fast  Cruise 

10,000 

Up 

375 

0.67 

477 

Low  Slow  Cruise 

10,000 

Up 

250 

0.45 

212 

Low  Configured 

10,000 

Down 

210 

0.38 

150 

The  different  target  profiles  (push-up,  pull-over,  etc.)  were  not  treated  as  factors  in  the 
experiment.  The  profiles  served  the  purpose  of  inducing  boundary  avoidance  events  for  study, 
and  the  overall  nature  of  the  response  was  assumed  to  be  independent  of  the  trigger.  Therefore, 
not  every  target  profile  was  required  at  every  test  point  to  successfully  gather  data. 

Because  of  the  inescapable  human  element  of  the  experiment,  the  individual  pilots  could 
possibly  generate  different  results  while  performing  closed-loop  tasks  under  similar  conditions. 
Control  aggressiveness,  reaction  speed,  and  self-limitation  (real-world  shackles  to  avoid  over-g 
or  excessive  buffet)  could  potentially  vary  widely  from  pilot  to  pilot.  Because  the  pilot  was  a 
key  factor  in  the  experiment,  closed-loop  data  were  obtained  from  all  of  the  pilots  at  each  test 
condition.  While  open-loop  results  could  conceivably  vary  slightly  from  pilot  to  pilot,  they  were 
assumed  to  be  independent  of  pilot  technique  but  were  sampled  by  each  pilot  to  ensure  they  were 
indeed  independent  and  that  adequate  data  existed  for  study. 

Data  Collection 

Three  types  of  data  were  required  for  this  project:  (1)  the  view  of  the  target  aircraft  from 
the  perspective  of  the  test  pilot  to  capture  the  pilot’s  view;  (2)  a  time  history  of  the  longitudinal 
stick  position  of  the  test  aircraft  to  record  the  test  pilot’s  inputs  to  the  system;  and  (3)  pilot 
comments.  All  three  sets  of  data  were  captured  with  each  event  except  on  Flight  8,  when  the 
recorder  failed  to  function. 

Video  was  required  to  record  the  tracking  and  boundary  stimuli  as  seen  by  the  pilot  of  the 
test  aircraft.  Three  camera  systems  were  employed:  an  aircraft-mounted  camera,  a  helmet- 
mounted  camera,  and  a  digital  video  handheld  camera  operated  by  the  rear  cockpit  occupant. 
For  reasons  explained  below,  only  the  aircraft-mounted  camera  produced  consistently  acceptable 
results. 

The  aircraft-mounted  camera  was  installed  immediately  behind  the  ejection  seat  of  the 
front  cockpit,  approximately  three  feet  behind  and  slightly  higher  than  the  eyes  of  the  pilot.  The 
aircraft-mounted  camera  location  is  shown  in  figure  4.  The  camera  was  fixed  into  position  by  a 
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bracket  so  some  amount  of  trial  and  error  was  required  to  properly  align  the  eamera’s  field  of 
view;  however,  once  calibrated  the  camera  required  no  maintenance  or  recalibration  throughout 
the  testing.  The  installation  of  the  aircraft-mounted  camera  was  a  minor  modifieation  that 
integrated  the  camera  with  the  aircraft  electrical  system  for  power  and  with  three  8mm  tape 
decks  in  the  rear  coekpit  (one  recorded  the  produetion  aireraft  HUD/MFD  feed,  the  second 
recorded  the  aircraft-mounted  camera  feed,  and  the  third  recorded  the  data  acquisition  system 
data).  All  three  tapes  contained  a  time  stamp  for  data  synehronization.  The  video  frame  rate 
was  30  frames  per  second. 


Figure  4:  Aircraft-Mounted  Camera  Placement 


The  handheld  and  helmet-mounted  camera  systems  proved  to  be  insufficiently  reliable 
over  the  course  of  the  flight  test  program.  Flandheld  digital  video  from  the  rear  cockpit  of  the 
test  aircraft  tended  to  be  shaky  and  the  canopy  bows  occasionally  blocked  the  line  of  sight  during 
test  points.  It  also  lacked  an  accurate  time  stamp  and  lacked  any  aireraft  intercom  audio.  A 
helmet-mounted  camera  with  all  components  self-eontained  in  a  modified  survival  vest  rarely 
captured  the  target  aircraft  fully  in  the  field  of  view  despite  repeated  calibrations  and 
adjustments.  Despite  the  inconsistency  of  these  other  cameras,  the  aircraft-mounted  camera 
suecessfully  reeorded  all  of  the  test  points  (with  exception  of  one  flight)  and  provided  all  of  the 
video  data  for  this  technieal  report. 

Longitudinal  stick  position  of  the  test  aircraft  was  recorded  by  the  aircraft  data  acquisition 
system  (DAS).  The  sampling  rate  was  20  Hz.  Stick  position  was  in  degrees. 

Pilot  comments  were  recorded  by  the  aireraft-mounted  camera  audio  feed.  Comments  of 
partieular  interest  dealt  with  pilot  stimuli.  Pilot  comments  pertaining  to  whether  they  were 
performing  the  tracking  task  or  avoiding  a  boundary  were  particularly  valuable  for  interpreting 
the  stiek  inputs  and  correlating  them  to  the  visual  data. 
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Open-loop  Characteristics:  System  Time  Delay 

System  time  delay  is  the  lag  time  between  the  pilot’s  input  and  the  response  of  the  aireraft. 
Exeessive  system  time  delays  have  often  been  associated  with  poor  handling  qualities  and  pilot- 
in-the-loop  oscillations.  In  systems  with  excessive  time  delays,  several  phenomena  may  be 
present.  First,  pilots  may  feel  compelled  to  make  corrections  sooner  to  compensate  for  the 
delayed  response.  Second,  as  the  aircraft  fails  to  respond  to  an  input  in  a  timely  manner,  the 
pilot  may  make  a  more  aggressive  input  to  avoid  or  escape  the  boundary.  Third,  if  the  input 
becomes  too  aggressive  and  the  response  lag  is  extreme,  the  aircraft  may  rapidly  approach 
operating  limitations  (an  over-stress  boundary)  or  rapidly  approach  a  second  boundary. 

To  obtain  the  system  time  delay  data,  the  test  aircraft  stabilized  in  the  standard  tracking 
formation  position  off  of  the  target  aircraft.  The  target  aircraft  provided  a  stable  reference 
platform  by  maintaining  straight  and  level,  unaccelerated  flight.  When  cleared  to  maneuver,  the 
pilot  of  the  test  aircraft  performed  an  aft  stick  step  input. 

After  the  flight,  the  system  time  delay  was  calculated  as  the  length  of  time  between  two 
events:  the  pilot’s  initial  movement  of  the  stick  from  the  trim  position,  and  the  initial  response  of 
the  aircraft.  Definite  stick  movement  was  determined  by  a  rapid  stick  deflection  beyond  the 
noise  levels  observed  while  stabilized  in  the  trim  condition.  The  step  inputs  were  of  sufficient 
quality  to  readily  identify  the  moment  the  input  was  commenced.  The  time  of  the  first  aircraft 
response  was  determined  by  watching  the  video  data,  freezing  the  video  at  the  first  frame  with 
definite  vertical  movement,  and  noting  the  time  of  the  frame.  This  analysis  technique  closely 
reproduced  the  perception  of  the  airborne  pilot  that  the  input  had  taken  effect. 

Table  2  summarizes  the  system  time  delays  for  each  flight  condition.  The  time  delay 
values  were  calculated  from  one  test  run  at  each  flight  condition.  The  Mach  and  total  dynamic 
pressure  values  were  calculated  using  standard  atmosphere  pressure  ratios.  Figure  5  depicts  the 
system  time  delays  as  functions  of  altitude  and  indicated  airspeed.  Hand-faired  curves  were 
drawn  through  test  points  at  a  given  altitude  to  illustrate  the  trends  from  the  data  and  verify  the 
absence  of  gross  outliers.  The  system  time  delay  was  treated  as  independent  of  the  gear  position 
because  the  flight  control  system  was  unaffected  and  parasitic  drag  was  not  relevant  to  the 
response  time;  therefore,  the  curves  connect  points  regardless  of  whether  the  gear  were  extended 
or  retracted.  The  system  time  delays  showed  nearly  identical  behavior  when  plotted  as  a 
function  of  Mach  rather  than  indicated  airspeed. 
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Table  2:  System  Time  Delays 


Flight  Condition 

Altitude 

(feet) 

Landing  Gear 
Position 

Airspeed 

(KIAS) 

Typical 

Mach 

Typical  Dynamic 
Pressure,  q 
(pounds/square  foot) 

System 
Time  Delay 
(seconds) 

High  Fast  Cruise 

20,000 

Up 

375 

0.80 

477 

High  Slow  Cruise 

20,000 

Up 

250 

0.55 

212 

0.17 

High  Configured 

20,000 

Down 

210 

0.46 

150 

0.30 

Low  Fast  Cruise 

10,000 

Up 

375 

0.67 

477 

0.03* 

Low  Slow  Cruise 

10,000 

Up 

250 

0.45 

212 

0.10 

Low  Configured 

10,000 

Down 

210 

0.38 

150 

0.17 

*  Note:  The  data  sampling  rates  limited  the  precision  of  the  system  delays  when  less  than  1/20  of  a  second. 


0.35 


0.30 


0.25 


0.20 


0.15 


0.10 


0.05 


NOTE:  All  curves  hand- 

faired 

Data  Source:  Flight  Test 
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Figure  5:  System  Time  Delays  at  the  Test  Flight  Conditions 


Open-loop  Characteristics:  System  Crossover  Frequency 

Currently  prevailing  handling  qualities  paradigms  link  phase  lag  with  undesirable 
tendencies,  particularly  when  pilot-in-the-loop  oscillations  (PIO)  enter  the  discussion.  Definition 
of  a  PIO  often  includes  the  requirement  that  the  cause  (stick  input)  and  effect  (aircraft  motion)  be 
180  degrees  out  of  phase.  Because  boundary  avoidance  tracking  events  between  opposing 
boundaries  can  result  in  divergent  oscillations  that  look  and  feel  like  a  PIO,  HAVE  BAT 
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included  frequency  analysis  in  the  investigation  to  compare  the  boundary  avoidance  tracking 
phenomenon  to  the  characteristics  of  the  classic  PIO.  This  analysis  compared  the  stick 
oscillation  frequency  at  which  out-of-phase  behavior  was  observed  (the  system  crossover 
frequency)  to  the  actual  frequencies  (the  “pilot  actuation  frequencies”)  observed  during  flight  test 
closed-loop  tasks. 

The  system  crossover  frequency  (coigo)  is  defined  for  this  study  as  the  rate  at  which  an 
oscillatory  pitch  input  by  the  pilot  results  in  the  opposite  vertical  movement  from  the  aircraft. 
When  cycling  the  stick  at  this  frequency,  the  aircraft  will  climb  during  forward  stick  application 
and  descend  during  aft  stick  application  because  the  aircraft  is  still  responding  to  the  previous 
input  (a  symptom  of  system  time  delay  described  earlier).  If  the  pilot’s  input  is  slower  than  the 
crossover  frequency,  the  aircraft  will  follow  the  stick  inputs  (aft  stick  results  in  a  climb,  as  one 
would  expect);  if  the  pilot’s  input  is  faster,  the  aircraft  does  not  have  enough  time  to  respond  to 
the  rapidly  alternating  commands  and  merely  twitches  near  the  trim  state.  The  system  crossover 
frequency  is  of  interest  because  if  the  pilot  makes  repeated  corrections  at  this  rate  (such  as  when 
bouncing  between  two  opposing  boundaries),  the  aircraft  may  move  in  a  direction  opposite  what 
the  pilot  is  commanding  and  anticipating.  Such  a  situation  increases  the  potential  for  divergent 
oscillations  and  classic  pilot-in-the-loop  oscillations. 

The  system  crossover  frequency  investigation  required  the  test  aircraft  to  perform  a 
frequency  sweep  in  pitch  while  at  or  near  the  standard  formation  position  off  the  target  aircraft. 
To  perform  the  frequency  sweep,  the  pilot  made  slow,  alternating  inputs  of  small  stick 
deflections  and  gradually  increased  the  frequency.  Once  the  pilot  perceived  the  aircraft  vertical 
movement  to  be  out  of  phase  with  the  stick  deflection,  the  pilot  dwelled  at  that  frequency  to 
record  a  sufficient  stick  trace  on  the  DAS  for  later  analysis.  Throughout  the  frequency  sweep, 
the  pilot  adjusted  stick  deflections  to  keep  the  target  aircraft  within  the  field  of  view  of  the 
aircraft-mounted  camera  for  post-flight  video  analysis.  Post-flight  analysis  entailed  measuring 
the  period  of  the  oscillations  and  taking  the  reciprocal  to  determine  coigo. 

The  measured  system  crossover  frequencies  are  listed  in  table  3  and  depicted  in  figure  6  as 
a  function  of  aircraft  Mach  number.  Overall,  the  pilot  had  to  oscillate  the  stick  more  rapidly  at 
higher  Mach  numbers  or  with  the  landing  gear  extended  to  obtain  out-of-phase  response  from  the 
aircraft.  Two  straight  lines  -  one  line  through  the  points  with  the  gear  retracted  and  another  line 
through  the  two  points  with  the  gear  extended  -  were  hand-faired  to  indicate  trends  and  verify 
the  absence  of  gross  outliers.  Clear  trends  were  not  readily  identifiable  when  plotted  against 
indicated  airspeed  rather  than  Mach  number. 
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Table  3:  System  Crossover  Frequencies 


Flight  Condition 

Altitude 

(feet) 

Landing 

Gear 

Position 

Airspeed 

(KIAS) 

Mach 

System 

Crossover 

Frequency 

(Hz) 

High  Fast  Cruise 

20,000 

Up 

375 

0.80 

0.88 

High  Slow  Cruise 

20,000 

Up 

250 

0.55 

0.59 

High  Configured 

20,000 

Down 

210 

0.46 

0.56 

Low  Fast  Cruise 

10,000 

Up 

375 

0.67 

0.71 

Low  Slow  Cruise 

10,000 

Up 

250 

0.45 

0.45 

Low  Configured 

10,000 

Down 

210 

0.38 

0.45 

NOTE:  All  curves  h 

and-falred 
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3d 

Data  Source:  Flight  Test 

Aircraft:  T-38C  /  64-13197 

Test  Dates:  10  Apr  -  4  May  06 

Test  Conditions: 

10K/20KFT  PA  -  210  KIAS  -  PA  Config 
10K/20K  FT  PA  -  250  KIAS  -  CR  Config 
10K/20K  FT  PA  -  375  KIAS  -  CR  Config 

- 

0.60 

Mach 


Figure  6:  System  Crossover  Frequency  Results 


Closed-loop  Pilot  Actuation  Frequency 

The  pilot  actuation  frequencies  were  determined  much  like  the  system  crossover 
frequencies  by  searching  the  DAS  stick  deflection  data  during  boundary  avoidance  tracking  for 
multiple  oscillations  and  measuring  the  period.  Typically,  at  least  two  sequences  of  readily 
identifiable  constant-frequency  oscillations  would  be  present,  revealing  two  predominant 
frequencies  (referred  to  here  as  low  and  high).  Figure  7  illustrates  this  analysis  technique  on  a 
sample  plot  of  stick  deflection.  The  two  discernable  pilot  actuation  frequencies  were  0.80  and 
2.56  Hz.  Of  note,  the  pilot  commented  in  flight  that  he  was  performing  tracking  during  the  0.80 
Hz  oscillations,  but  not  during  the  2.56  Hz  oscillations  that  preceded  a  high-gain  boundary 
escape  and  subsequent  boundary  penetration  in  the  other  direction.  Fast  Fourier  Transforms 
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were  examined  but  not  used  for  analysis  because  the  frequencies  of  interest  (especially  the 
system  crossover  frequencies)  were  buried  in  a  spike  of  frequencies  below  5  Hz.  For  a  human- 
driven  mechanical  feedback  system,  higher  frequencies  would  be  extremely  unlikely.  Also,  the 
pilot  theoretically  need  only  cycle  the  stick  at  the  crossover  frequency  a  few  times  to  unleash  the 
effects.  That  chain  of  events  would  be  evident  during  the  study  of  the  time  series. 


DAS  Time  Stamp  (seconds) 


Figure  7:  Example  Pilot  Actuation  Frequency  Analysis 


Pilot  actuation  frequencies  measured  from  a  run  at  each  flight  condition  are  listed  in 
table  4.  The  pilot  actuation  frequencies  were  higher  than  the  system  crossover  frequencies  with 
the  smallest  difference  at  the  250  KIAS  conditions.  Inspection  of  the  data  in  the  time  domain 
confirmed  that  the  system  never  responded  180  degrees  out  of  phase  with  the  pilot. 


Table  4:  Calculated  Pilot  Actuation  Frequencies 


Flight  Condition 

Altitude 

(feet) 

Landing 

Gear 

Position 

Airspeed 

(KIAS) 

Low 

Frequency 

(Hz) 

High 

Frequency 

(Hz) 

High  Fast  Cruise 

20,000 

Up 

375 

1.03 

2.78 

High  Slow  Cmise 

20,000 

Up 

250 

0.68 

2.78 

High  Configured 

20,000 

Down 

210 

0.75 

1.41 

Low  Fast  Cruise 

10,000 

Up 

375 

0.80 

2.56 

Low  Slow  Cmise 

10,000 

Up 

250 

0.56 

2.54 

Low  Configured 

10,000 

Down 

210 

0.61 

1.92 
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Determination  of  Closed-loop  Boundary  Avoidance  Parameters 

Six  (6)  closed-loop  tracking  events  were  selected  from  the  collected  data  for  each  flight 
condition  and  configuration  considered.  Initial  qualitative  analysis  of  push-over,  pull-up,  and 
rollereoaster  events  showed  some  similarities  between  both  push-over  and  pull-up  events;  as 
such,  only  these  two  types  of  maneuvers  were  initially  considered.  The  analysis  and  data 
provided  assumes  that  the  push-over  and  pull-up  events  are  suffieiently  similar  as  to  provide 
direetly  comparable  results.  Further  analysis  must  be  condueted  to  determine  if  the  rollercoaster 
maneuvers  can  be  compared  directly  with  push-over  and  pull-up  data. 

To  determine  the  boundary  avoidance  tracking  parameters,  the  test  team  developed  the 
BAT  MATLAB®  routine  to  ealeulate  and  display  the  continuously  changing  time-to-boundary 
during  a  test  run.  The  time-to-boundary  at  a  point  in  time  was  calculated  as  the  distance  of  the 
wingtip  referenee  from  the  boundary  divided  by  the  rate  of  travel  of  the  wingtip  towards  the 
boundary.  An  example  data  plot  from  the  BAT  routine  is  provided  in  figure  8  to  illustrate  how 
boundary  tracking  parameters  were  determined  direetly  from  the  eolleeted  data.  The  value  of 
Kbm  corresponded  to  the  maximum  stick  position  seen  during  the  boundary  avoidanee  tracking 
event.  Two  points  for  Kbm  were  required  as  both  a  maximum  forward  and  aft  stick  position  were 
associated  with  both  lower  and  upper  boundary  avoidance  traeking  events  -  point  A  depiets  the 
greatest  aft  stick  deflection,  and  point  B  depicts  the  greatest  forward  stick  deflection.  Since  tmax 
corresponded  to  the  time-to-boundary  at  which  the  greatest  stick  deflection  was  observed,  traeing 
each  line  down  from  the  stick  position  plot  to  the  time-to-boundary  plot  revealed  the 
eorresponding  values  for  tmax- 

To  complete  the  analysis,  values  for  tmin  had  to  be  determined.  Based  on  simulator  test 
results  (referenees  1,2),  the  test  team  expeeted  that  tmm  would  correspond  with  a  rapid  ehange  in 
stiek  position  seen  as  the  pilot  began  to  input  into  the  system  based  on  the  encroaching 
boundaries.  However,  due  to  the  complieated  flight  dynamics  and  frequent  movement  of  the 
stiek  by  the  pilots  in  flight,  visually  inspeeting  the  time  series  data  to  ascribe  particular  stick 
movements  to  boundary  stimuli  unexpectedly  proved  intraetable.  Appendix  E  contains  the  BAT 
MATLAB®  output  plots  for  all  of  the  closed-loop  test  runs;  each  demonstrates  likewise  that  the 
direct  determination  of  tmin  from  the  eolleeted  data  was  oceluded  by  noise  and  non-attributable 
stick  movements.  Pilot  eomments  also  did  not  provide  such  a  correlation  because  the  time  delay 
from  the  pilot  boundary  reaetion  to  the  audible  remark  by  the  pilot  spanned  multiple  stick 
movements.  Since  only  two  of  the  three  parameters  could  be  determined  by  direct  observation, 
an  alternate  method  was  used  to  determine  all  three  parameters:  a  predictive  model. 
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To  obtain  the  required  boundary  avoidanee  traeking  parameters,  a  routine  previously 
developed  by  Mr.  William  Gray  was  employed.  This  routine,  named  BAT  GUI,  was  a  graphical 
user  interface  developed  in  MATLAB®  to  import  all  reduced  data  and  analyze  it  for  tmin,  tmax  and 
Kbm  by  applying  Mr.  Gray’s  boundary  tracking  model  (reference  1,2).  The  model  boundary 
parameters  were  varied  repeatedly  through  a  genetic  algorithm  developed  by  Mr.  Gray  until  a 
best  fit  of  the  collected  data  was  obtained  (i.e.,  the  model’s  prediction  of  stick  deflections  most 
closely  matched  the  actual  stick  deflections).  The  model  results  of  all  six  events  are  included  in 
appendix  F.  The  boundary  tracking  parameter  values  estimated  by  the  model  are  shown  in 
table  5. 
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Table  5:  Estimated  Values  of  the  Boundary  Tracking  Parameters 


Flight  Condition 

Altitude 

(feet) 

Landing 

Gear 

Position 

Airspeed 

(KIAS) 

tmin 

(sec) 

tmax 

(sec) 

Kbm 

BTP 

High  Fast  Cruise 

20,000 

Up 

375 

3.69 

0 

2.95 

1.25 

High  Slow  Cruise 

20,000 

Up 

250 

2.83 

1.31 

4.20 

0.36 

High  Configured 

20,000 

Down 

210 

2.07 

1.04 

0.98 

1.05 

Low  Fast  Cruise 

10,000 

Up 

375 

1.77 

1.35 

4.50 

0.09 

Low  Slow  Cruise 

10,000 

Up 

250 

3.49 

0.71 

5.78 

0.48 

Low  Configured 

10,000 

Down 

210 

2.50 

0.40 

7.65 

0.27 

The  model  and  assoeiated  BAT  GUI  routine  were  written  for  and  validated  in  simulator 
testing  using  test  proeedures  different  from  those  used  in  HAVE  BAT  flight  testing.  In  the 
simulator  testing,  the  stiek  trim  position  of  the  test  “aireraft”  never  changed.  In  contrast,  during 
HAVE  BAT  the  target  aircraft  maneuvered  to  a  target  load  factor  and  the  test  aircraft  trim  stick 
position  varied  during  the  course  of  each  test  maneuver.  This  was  not  accounted  for  in  the 
BAT  GUI  algorithm  and  introduced  errors  in  all  three  boundary  avoidance  tracking  parameters. 
In  an  attempt  to  minimize  the  effect  of  this  error,  the  test  team  attempted  to  set  the  trim  stick 
position  qualitatively  to  the  perceived  trim  position  during  the  boundary  avoidance  tracking 
event.  This  error  will  be  corrected  for  during  continued  analysis  of  the  data  for  continuing 
associated  projects. 

Relationships  Between  Open-loop  Characteristics  and  Boundary  Avoidance 

While  relationships  between  the  open-loop  parameters  and  boundary  avoidance  tracking 
parameters  were  examined,  statistical  significance  could  not  be  determined  because  hardware 
deficiencies  hampered  data  reduction.  The  camera  systems  that  collected  vital  video  data  did  not 
provide  video  of  sufficient  quality  for  automated  data  reduction.  Prior  to  flight  testing,  the 
HAVE  BAT  team  developed  MATEAB®  video  tracking  routines  that  would  automatically  track 
markings  of  unique  shape  and  color  attached  to  the  target  aircraft  and  convert  the  video  data  into 
numerical  data.  The  markings  consisted  of  groupings  of  yellow  and  red  circles  at  the  forward 
and  aft  ends  of  the  aircraft  and  green  covering  over  the  wingtip.  Armed  with  the  video  clip  of  a 
test  point,  the  data  analyst  would  distinguish  the  markings  for  the  tracking  software  and  run  the 
clip.  The  software  would  continuously  track  the  markings  and  output  time -tagged  pixel 
coordinates  for  further  computational  analysis.  Computer  simulations  and  tests  with  stock 
footage  validated  the  concept  and  the  process.  In  flight,  however,  the  camera’s  white  balance 
frequently  fluctuated  as  sun  angles  and  backgrounds  changed.  These  washouts  combined  with 
marginal  resolution  to  make  the  video  clips  unusable  by  the  tracking  software.  The  HAVE  BAT 
team  was  forced  to  resort  to  the  backup,  “brute  force”  data  reduction  process  of  manually 
clicking  on  the  video  data  frame  by  frame  (with  30  frames  per  second  of  video)  to  produce  the 
necessary  numerical  data.  This  manual  method  proved  to  be  excessively  time-consuming. 
Given  the  inflexible  time  constraints  of  the  project,  the  team  was  unable  to  reduce  the  massive 
volume  of  data  required  for  the  desired  rigorous  statistical  analyses.  Instead,  the  team  was 
forced  to  parse  the  data  and  select  only  the  most  representative  and  illustrative  test  points  for  in- 
depth  study  while  reserving  the  remaining  data  points  for  overall  comments  and  qualitative 
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comparisons.  A  wealth  of  quality  data  remains  to  be  examined  to  produee  more  rigorous 
analyses.  Reduce  and  analyze  the  remaining  data  gathered  by  HA  VE  BAT  (Rl). 

All  estimated  elosed-loop  parameters  were  plotted  as  functions  of  the  open-loop 
parameters  to  determine  the  degree  of  eorrelation.  All  plots  are  presented  in  appendix  G.  The 
relationship  that  showed  the  strongest  eorrelation  was  that  of  the  Boundary  Traeking  Parameter 
to  the  System  Time  Delay.  Most  other  data  showed  little  apparent  eorrelation  given  the  limited 
data  available.  Overall,  there  is  evidenee  that  a  relationship  between  both  system  time  delay  and 
system  crossover  frequency  exists  with  the  boundary  avoidanee  traeking  parameters.  Though 
this  relationship  was  not  apparent  from  the  eurrent  set  of  analyzed  data,  based  on  the  test  team’s 
experienee  and  pilot  eomments  during  this  projeet  boundary  avoidanee  behavior  was  affeeted  by 
the  system  open-loop  eharaeteristies  and  more  study  is  warranted.  Further  investigate  the 
boundary  tracking  phenomenon  (R2). 

To  examine  the  system  open-loop  effeets  in  the  frequeney  domain,  the  system  erossover 
frequeneies  were  eompared  to  the  pilot  aetuation  frequeneies  (table  6).  Aeross  all  flight 
eonditions  examined,  the  pilots  tended  to  operate  at  frequeneies  higher  than  the  system  erossover 
frequencies.  At  no  point  did  the  pilots  dwell  at  the  system  erossover  frequeney  for  that  flight 
eondition.  As  expeeted,  out-of-phase  control  was  therefore  not  observed  during  any  test  runs.  It 
is  interesting  that  the  pilots  did  operate  at  the  system  erossover  frequeney  for  other  flight 
eonditions  -  for  example,  during  the  “Low  Slow  Cruise”  test  run  the  pilot  dwelled  at  0.56  Hz,  the 
system  erossover  frequeney  if  eonfigured  at  20,000  feet.  This  indieates  that  the  pilots’  input 
patterns  adapted  to  the  flight  eonditions.  Insufficient  data  exist  to  determine  whether  the  pilots 
adapted  speeifieally  to  the  open-loop  parameters  studied  by  HAVE  BAT,  in  partieular  by  not 
dwelling  at  the  system  erossover  frequeney  beeause  the  undesirable  out-of-phase  tendeney  was 
unconseiously  sensed  and  avoided. 


Table  6:  Comparison  of  Pilot  Actuation  to  System  Crossover  Frequencies 


Flight  Condition 

Altitude 

(feet) 

Landing 

Gear 

Position 

Airspeed 

(KIAS) 

System 

Crossover 

Frequency 

(Hz) 

Low 

Frequency 

(Hz) 

High 

Frequency 

(Hz) 

High  Fast  Cruise 

20,000 

Up 

375 

0.88 

1.03 

2.78 

High  Slow  Cruise 

20,000 

Up 

250 

0.59 

0.68 

2.78 

High  Configured 

20,000 

Down 

210 

0.56 

0.75 

1.41 

Low  Fast  Cruise 

10,000 

Up 

375 

0.71 

0.80 

2.56 

Low  Slow  Cruise 

10,000 

Up 

250 

0.45 

0.56 

2.54 

Low  Configured 

10,000 

Down 

210 

0.45 

0.61 

1.92 

One  of  the  most  intriguing  findings  of  HAVE  BAT  dealt  with  the  nature  of  pereeived  pilot- 
in-the-loop  oseillations.  Despite  the  faet  that  the  pilots’  stiek  oseillation  rates  did  not  eorrespond 
to  system  erossover  frequency  and  180  degree  out-of-phase  response  was  not  observed,  the  pilots 
universally  described  the  divergent  boundary  episodes  as  feeling  like  a  PIO.  The  phase  lag  was 
measured  in  referenee  to  the  visual  pereeption  of  the  target  aireraft  -  perhaps  the  stiek  inputs 
were  indeed  out  of  phase  with  some  other  souree  of  feedbaek  (like  load  faetor)  that  was 
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surreptitiously  entering  the  feedbaek  loop  and  affeeting  the  pilot’s  eontrol  inputs.  However, 
examination  into  this  behavior  was  beyond  the  seope  of  this  study.  Examine  the  frequency 
aspect  of  boundary  avoidance  tracking-related pilot-in-the-loop  oscillations  (R3). 
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CONCLUSIONS  AND  RECOMMENDATIONS 

The  HAVE  BAT  TMP  demonstrated  the  eorrelation  of  system  open-loop  eharaeteristies 
and  boundary  avoidanee  traeking  parameters  through  the  use  of  visual  traeking  hardware  and 
software.  Though  the  designed  system  and  the  employed  system  varied  greatly,  the  projeet  was 
able  to  employ  several  reserve  assets  to  obtain  the  data  required  for  analysis.  The  following 
reeommendations  address  the  issues  that  resulted  from  the  use  of  a  visual  traeking  system  to 
obtain  the  data  required  for  HAVE  BAT. 

While  relationships  between  the  open-loop  parameters  and  boundary  avoidanee  traeking 
parameters  were  indeed  examined,  statistieal  signifieanee  eould  not  be  determined  beeause 
hardware  defieieneies  hampered  data  reduetion.  The  eamera  systems  that  eolleeted  vital  video 
data  did  not  provide  video  of  suffieient  quality  for  automated  data  reduetion.  Given  the 
inflexible  time  eonstraints  of  the  projeet,  the  team  was  unable  to  reduee  the  massive  volume  of 
data  required  for  the  desired  rigorous  statistieal  analyses.  Instead,  the  team  was  foreed  to  parse 
the  data  and  seleet  only  the  most  representative  and  illustrative  test  points  for  in-depth  study 
while  reserving  the  remaining  data  points  for  overall  eomments  and  qualitative  eomparisons.  A 
wealth  of  quality  data  remains  to  be  examined  to  produee  more  rigorous  analyses.  Reduce  and 
analyze  the  remaining  data  gathered  by  HA  VE  BAT  (Rl,  page  18). 

The  relationship  that  showed  the  strongest  eorrelation  was  that  of  the  Boundary  Traeking 
Parameter  to  the  System  Time  Delay.  Most  other  data  showed  little  apparent  eorrelation  given 
the  limited  data  available.  However,  there  is  evidenee  that  a  relationship  between  both  system 
time  delay  and  system  erossover  frequeney  exists  with  the  boundary  traeking  parameters. 
Though  this  relationship  was  not  apparent  from  the  eurrent  set  of  analyzed  data,  based  on  the  test 
team’s  experienee  and  pilot  eomments  during  this  projeet  boundary  avoidanee  behavior  was 
affeeted  by  the  system  open-loop  eharaeteristies  and  more  study  is  warranted.  Further 
investigate  the  boundary  tracking  phenomenon  (R2,  page  18). 

Aeross  all  flight  eonditions  examined,  the  pilots  tended  to  operate  at  frequeneies  higher 
than  the  system  erossover  frequeneies.  At  no  point  did  the  pilots  dwell  at  the  system  erossover 
frequeney  for  that  flight  eondition.  As  expeeted,  out-of-phase  eontrol  was  therefore  not  observed 
during  any  test  runs.  Despite  the  faet  that  the  pilots’  stiek  oseillation  rates  did  not  eorrespond  to 
system  erossover  frequeney  and  180  degree  out-of-phase  response  was  not  observed,  the  pilots 
universally  deseribed  the  divergent  boundary  episodes  as  feeling  like  pilot-in-the-loop 
oseillations.  Examine  the  frequency  aspect  of  boundary  avoidance  tracking-related  pilot-in- 
the-loop  oscillations  (R3,  page  19). 

HAVE  BAT  was  the  first  program  to  gather  flight  test  data  on  the  eoneept  of  boundary 
avoidanee  traeking.  The  test  team  observed  first-hand  that  (1)  pilots  adapt  their  eontrol  inputs 
based  on  the  handling  qualities  of  the  aireraft  and  the  level  of  threat  posed  by  a  boundary,  and  (2) 
that  the  imposition  of  boundaries  ean  lead  to  divergent  oseillations.  Eurther  examination  eould 
reveal  mueh  about  how  pilots  reaet  to  stimuli  and  how  the  system  eharaeteristies  impaet  the  final 
outeome. 
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APPENDIX  A  -  BOUNDARY  AVOIDANCE  PARAMETER 
DEVELOPMENT 


One  boundary  avoidance  tracking  parameter  of  interest  was  the  time  to  boundary  (t*).  The 
value  of  th  was  a  function  of  distance  to  (or  the  displacement  from)  a  predetermined  boundary 
{Dh)  and  the  rate  towards  that  boundary  (r*).  The  rate  towards  the  boundary  was  the  first 
derivative  of  the  displacement  from  the  boundary.  This  relationship  is  shown  in  the  following 
equation. 


The  other  parameters  of  interest,  tmin  and  tmax,  were  respectively  the  times  at  which  the 
minimum  and  maximum  feedback  gain  occurred  during  a  boundary  avoidance  event.  The 
relationship  of  tmin  and  tmax,  to  the  boundaries  are  shown  in  figure  A-1,  where  the  feedback  gain 
is  represented  by  the  oscillatory  time  history  of  stick  position. 


a 


LU 
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TIME 


Figure  A-1:  Relationships  of  tmin  and  tmax  with  respect  to  boundaries 


The  point  tracking  task  was  modeled  with  a  simple  feedback  system,  containing  a  "plant", 
and  a  loop  with  feedback  saturation  and  delay  (reference  1,2)  .  The  plant  could  have  been  a 
spring-mass-damper  system,  or  open-loop  aircraft  characteristics.  The  pilot  was  represented  by 
the  saturation  and  delay  in  the  feedback  loop.  Adding  boundary  avoidance  along  with  point 
tracking  required  the  addition  of  a  parallel  feedback  loop.  The  boundary  avoidance  model  can  be 
seen  in  figure  A-2.  Two  boundaries  and  a  point  tracking  task  were  contained  in  this  model  and 
only  one  boundary  is  respected  at  a  time,  based  on  priority.  The  boundary  avoidance  tracking 
feedback  gain,  Kt,m,  was  contained  in  each  boundary  feedback  loop. 
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Figure  A-2:  Boundary  Avoidance  feedback  model 


It  was  hypothesized  that  contribution  of  K/,^  was  a  function  of  time  to  the  boundary  (4), 
tmin,  and  tmax-  This  relationship  is  shown  in  figure  A-3.  When  the  pilot  was  at  tmax,  it  was  the 
time  where  maximum  feedback  gain  occurred  to  avoid  the  boundary.  As  the  time  to  the 
boundary  increased,  the  gain  decreased  until  tmin  was  reached,  this  was  the  point  of  minimum 
boundary  avoidance.  At  times  above  tmin,  the  pilot  was  thought  to  switch  back  to  a  point  tracking 
task  and  disregarded  the  boundary.  The  relationship  between  the  boundary  avoidance  tracking 
feedback  gain  and  the  times  that  bounded  it  can  be  shown  in  the  following  equation  (equation 
A-1). 

[Equation  A-1] 

v^min  ^max  / 
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Figure  A-3:  Variable  gain  (equivalent  to  stick  deflection)  during  boundary  avoidance 

tracking 

A  pilot  makes  either  a  conseious  or  subconscious  decision  to  abandon  point  tracking  (or 
chooses  to  disregard  the  boundaries).  However,  as  shown  in  figure  A-2,  there  are  multiple 
feedback  loops,  and  there  could  be  instances  a  pilot  could  be  in  a  point  tracking  task  while  being 
aware  of  and  reacting  to  a  boundary,  but  at  boundary  avoidance  gains  much  lower  than  what  is 
required  for  the  point  tracking  task. 

However,  for  the  purposes  of  this  testing  the  test  team  assumed  these  feedback  loops  were 
mutually  exclusive  and  when  a  pilot  switched  between  the  feedback  loops,  the  other  loop  is 
disregarded.  This  was  felt  to  be  a  safe  assumption  as  the  responses  to  the  feedback  of  the  lower 
priority  task  was  so  small  as  to  be  thought  of  as  nonexistent.  This  assumption  required  the  test 
pilot  to  verbalize  when  they  switched  from  point  tracking  to  boundary  avoidance  tracking,  and 
vice  versa.  This  verbalization  should  also  allow  for  a  determination  of  imin  when  switching 
tracking  modes. 

was  thought  to  be  analogous  to  the  amplitude  of  the  stick  deflection  required  to  avoid 
a  boundary.  Small  stick  displacements  when  the  boundary  was  not  a  threat,  and  full 
displacements  for  maximum  effort  to  avoid  a  boundary  were  good  examples  of  the  relation 
between  Kbm  and  stick  displacement. 

It  was  hypothesized  that  tmin,  tmax  and  Kbm  were  constant  for  a  boundary  avoidance 
associated  with  a  particular  boundary  tracking  task.  The  value  of  tmin  was  determined  by  pilot 
comments  when  the  pilot  noted  boundary  avoidance  tracking  began  and  it  was  be  assumed  to  be 
at  minimum  gain.  In  the  instances  of  boundary  avoidance  tracking,  the  magnitude  of  the  stick 
displacement  was  thought  to  be  representative  of  the  gain  Kbm  applied  to  the  feedback  model. 
The  value  for  tmax  was  the  time-to-boundary  when  the  maximum  gain  was  applied.  The  values 
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for  Kbm,  tmin  aiid  tmax  Call  bc  Combined  into  one  parameter,  dubbed  the  Boundary  Traeking 
Parameter  (BTP)  as  shown  in  equation  A-2. 

it  -t  ) 

gjp  ^  Imm - ma^  [Equation  A-2] 

^hm 

During  a  sustained  boundary  avoidanee  traeking  event,  it  was  thought  that  there  would  be  a 
frequeney  that  the  pilot  makes  eonsistently  high  gain  inputs  in  order  to  keep  from  violating  a  set 
of  boundaries.  This  frequeney  was  termed  the  pilot  aetuation  frequeney,  and  was  measured 
during  sustained  boundary  avoidanee  traeking  events.  It  was  thought  that  the  pilot  actuation 
frequency  would  be  eonstant  for  boundary  avoidanee  assoeiated  with  a  partieular  traeking  task. 
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APPENDIX  B  -  AFRL  SIMULATOR  PREPARATION 

In  March  2006,  the  HAVE  BAT  team  traveled  to  Wright  Patterson  AFB,  OH,  to  use  a  T-38 
simulator  in  preparation  for  flight  testing.  The  Infinity  Cube  simulator  of  AFRL/VACD  was  a 
full  non-linear  six  degree  of  freedom  simulation  of  the  T-38  A  aireraft  developed  over  a  one-year 
period  for  use  in  this  project.  The  handling  qualities  of  the  simulator  were  good  representations 
of  the  aetual  aireraft  and  the  simulator  provided  an  excellent  visual  presentation  of  a  target 
T-38A  aireraft.  Figure  B-1  depiets  the  view  available  to  the  pilots  during  a  simulator  session. 


Figure  B-1:  AFRL  Simulator  Visual  Presentation 


Eaeh  potential  target  profile  was  flown  and  reeorded  by  the  simulator.  Then,  the  console 
operator  reset  the  simulator,  input  a  location  shift  to  place  the  target  aircraft  in  the  proper 
loeation,  and  replayed  the  profile  while  the  HAVE  BAT  pilot  flew  formation.  The  test  team 
validated  numerous  target  profiles  in  this  manner  and  seleeted  the  most  effective  for  later  use. 
Overall,  the  AFRL  simulator  was  instrumental  in  developing  and  rehearsing  the  flight  test 
techniques  later  employed  in  flight  testing. 
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APPENDIX  C  -  SORTIES  AND  TEST  POINTS  FLOWN 

Table  C-1  details  the  HAVE  BAT  test  flights  and  the  test  points  performed  on  eaeh.  Eaeh 
HAVE  BAT  flight  eonsisted  of  one  test  aireraft  and  one  target  aireraft. 

Table  C-1:  Sorties  and  Test  Points  Flown 


FLIGHT 

DATE 

2006 

PILOT 

10,000  feet 

20,000  feet 

375  KIAS 
Gear  Up 

250  KIAS 
Gear  Up 

210  KIAS 
Gear  Down 

375  KIAS 
Gear  Up 

250  KIAS 
Gear  Up 

210  KIAS 
Gear  Down 

1 

10  Apr 

3 

OT 

OT 

O 

2 

14  Apr 

2 

OT 

OT 

O 

3 

19  Apr 

3 

T 

T 

T 

T 

4 

20  Apr 

2 

T 

T 

T 

T 

5 

21  Apr 

3 

Flight  dedicated  to  trail  task  execution 

6 

24  Apr 

1 

T 

T 

OT 

7 

25  Apr 

2 

T 

T 

T 

8 

1  May 

1 

fOTJ 

fOTJ 

[OT] 

9 

2  May 

1 

OT 

OT 

OT 

T 

10 

4  May 

2 

O 

OT 

O 

OT 

OT 

Notes: 

1 .  Altitudes  are  Pressure  Altitude 

2.  The  pilot  of  the  test  aircraft  is  indicated  as  pilot  1,  2,  or  3 

3.  “O”  indicates  open-loop  test  points  and  “T”  indicates  closed- loop  tracking  tasks  at  the  flight  condition 

4.  The  aircraft-mounted  camera  failed  to  function  on  Flight  8  so  no  video  data  was  collected 
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APPENDIX  D  -  DATA  REDUCTION 

Data  reduction  tools  consisted  of  both  commercial  off-the-shelf  software  and  locally 
created  MATLAB®  routines.  Each  served  a  specific  purpose  in  reducing  the  separate  streams  of 
data  and  integrating  them  into  the  required  data  products  for  analysis.  After  each  flight,  data 
reduction  generally  followed  two  tracks  in  parallel;  one  for  the  video  data,  and  one  for  the  stick 
deflection  data.  The  two  data  streams  were  integrated  at  the  last  step  to  produce  the  final  data 
products  for  analysis.  Figure  D-1  illustrates  the  flow  of  data  through  the  data  reduction  process. 


Figure  D-1:  Data  Reduction  Flow  Chart 

The  onboard  camera  used  to  capture  the  pilot’s  perspective  stored  the  captured  images  on 
an  analog  tape.  To  process  the  video  digitally,  a  commercial  off-the-shelf  video  tape  player 
converted  the  analog  signal  to  an  uncompressed  version  of  the  Audio  Video  Interleave  (AVI)  file 
format  and  digitally  exported  the  file  to  a  computer  via  an  Institute  of  Electrical  and  Electronics 
Engineers  (IEEE)  standard  1394  bus  also  known  as  FireWire. 

Once  the  analog  file  was  converted  to  a  digital  format,  Adobe  Premiere®  was  used  to 
reduce  the  typical  14  gigabyte  video  file  into  a  more  manageable  2  gigabyte  size.  This  was  done 
by  deleting  the  nonessential  portions  of  the  typical  1  hour  and  15  minute  flight.  These  portions 
included  all  events  except  the  actual  test  points  which  were  typically  10  to  15  seconds  long.  The 
end  result  was  a  reduction  of  the  flights  video  length  from  1  hour  and  15  minutes  to  roughly  7 
minutes.  Two  seconds  of  video  data  prior  to  the  beginning  of  the  maneuver  were  collected  as  a 
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buffer  to  determine  trim  information  and  the  elip  was  ended  at  either  the  “terminate”  call  or 
when  the  aircraft  departed  the  field-of-view  (FOV)  of  the  camera.  The  15  to  17  minute  AVI  clip 
contained  all  the  pertinent  events  of  the  sortie  but  was  still  in  video  format.  To  analyze  each 
individual  10  to  15  second  event,  the  AVI  clip  was  parsed  and  converted  into  a  30  frames-per- 
second  (fps)  still  image  sequence  and  saved  in  individual  folders  descriptively  labeled  to 
organize  and  separate  individual  events. 

ScratchClick,  a  MATLAB®  routine  created  by  a  member  of  the  HAVE  BAT  team, 
converted  the  pilot’s  perspective  (converted  to  individual  frames  in  Adobe  Premiere®)  into 
numerical  data.  ScratchClick  enabled  the  analyst  to  cycle  from  frame  to  frame  of  a  desired 
event’s  video  and  select  multiple  points  per  frame.  These  selected  points  were  then  stored  for 
future  analysis.  To  determine  the  time-to-boundary  as  perceived  by  the  pilot,  six  points  of 
interest  per  frame  were  required;  one  at  the  leading  comer  of  the  target  aircraft  wingtip,  one  at 
the  tracking  reference  where  the  wingtip  was  to  be  maintained,  and  two  to  define  each  linear 
boundary  above  and  below  the  tracking  reference.  Figure  D-2  illustrates  the  ScratchClick 
interface  as  well  as  how  ScratchClick  displays  these  6  points.  From  this  information  the  vertical 
distances  from  the  tracking  point  to  the  wingtip  and  to  each  boundary  were  calculated.  Other 
key  features  include  an  image  export  section  which  converts  the  still  images  back  into  an  AVI 
format  which  also  includes  the  overlay  of  the  selected  points. 
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Figure  D-2:  Example  ScratchClick  Video  Data  Extraction 
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to  the  Referenee  Traek  Line) 


~  Upper  Boundary 
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Figure  D-3:  Example  ScratchClick  Video  Data  Extraction 


Figure  D-3  graphically  shows  how  the  six  points  seleeted  were  used  to  derive  the  time-to- 
boundary  eondition.  Points  1  and  2  defined  the  upper  boundary  while  5  and  6  defined  the  lower 
boundary.  Point  4,  the  leading  edge  of  the  wingtip,  was  the  referenee  point  the  pilot  was  using 
while  flying  the  tracking  task.  Point  3,  the  eenter  of  the  star,  was  used  to  define  the  path  the 
wingtip  followed  during  the  traeking  task.  Two  eritical  assumptions  were  made  to  determine  the 
time-to-boundary  using  point  3  as  a  referenee  traek  line.  The  first  was  that  the  ratio  between  the 
upper  and  lower  boundary  and  the  star  was  constant  throughout  the  test  event  envelope.  This 
allowed  the  traek  line  to  be  defined  by  a  single  point  (point  3)  and  two  distances  (distance  to  top 
and  distanee  to  bottom  boundary).  This  relationship  was  independent  of  video  eamera 
orientation  or  test  aireraft  pitch  attitude.  The  seeond  assumption  was  that  the  wingtip  traveled 
parallel  to  the  track  line  during  the  eourse  of  the  traeking  event.  With  the  slope  of  the  referenee 
traek  line  defined  and  the  wingtip  coordinates  known,  the  wingtip ’s  time-to-boundary  was  found. 

The  BAT  MATLAB®  routine  assimilated  and  synehronized  both  the  ScratehCliek  video- 
derived  data  deseribed  above  and  the  stick  deflection  data.  Because  the  sample  rates  were 
different,  the  routine  ereated  time  histories  at  the  faster  rate  of  the  video  (30  Hz)  and  linearly 
interpolated  the  stick  deflection  data  when  there  was  not  a  data  point  sampled  at  that  time.  The 
photo  interpretation  required  while  using  ScratehCliek  introduced  a  small  amount  of  noise  into 
the  data  from  frame  to  frame  that  was  amplified  when  derivatives  of  the  time  series  were  taken  to 
determine  the  time-to-boundary.  Therefore,  the  BAT  routine  also  applied  the  “5-point  moving 
average”  method  developed  by  engineers  at  NASA/Dryden  to  smooth  the  video  data.  Onee  the 
stick  deflection  data  rates  were  adjusted  and  the  noise  from  the  SeratchCliek  data  was  redueed, 
the  BAT  MATLAB®  routine  produced  the  outputs  found  in  appendix  E. 
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APPENDIX  E  -  DATA  PRODUCTS,  CLOSED-LOOP  TASKS 


Wingtip  Position  Relative  to  the  Tracking  Reference 


Time  (seconds) 


- Upper  Boundary  . Lower  Boundary  - Wingtip  Position 


Figure  E-1:  Closed-loop  Task  Time-to-Boundary  Results  (20,000  feet,  375  KIAS) 
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Wingtip  Position  Relative  to  the  Tracking  Reference 


Longitudinal  Stick  Deflection 


Time  to  Boundary 


Figure  E-2:  Closed-loop  Task  Time-to-Boundary  Results  (20,000  feet,  250  KIAS) 
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Wingtip  Position  Relative  to  the  Tracking  Reference 


Longitudinal  Stick  Deflection 


Time  to  Boundary 
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Figure  E-3:  Closed-loop  Task  Time-to-Boundary  Results  (20,000  feet,  210  KIAS) 
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Wingtip  Position  Relative  to  the  Tracking  Reference 
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Figure  E-4:  Closed-loop  Task  Time-to-Boundary  Results  (10,000  feet,  375  KIAS) 
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Wingtip  Position  Relative  to  the  Tracking  Reference 
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Figure  E-5:  Closed-loop  Task  Time-to-Boundary  Results  (10,000  feet,  250  KIAS) 
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Figure  E-6:  Closed-loop  Task  Time-to-Boundary  Results  (10,000  feet,  210  KIAS) 
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Figure  F-3:  Closed-loop  Task  Output  (20,000  feet,  210  KIAS) 
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Figure  F-5:  Closed-loop  Task  Output  (10,000  feet,  250  KIAS) 
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APPENDIX  G-  PLOTS  OF  OPEN/CLOSED  LOOP 
CORRELATIONS 

The  following  plots  are  the  final  data  produets  developed  from  both  the  open-  and  closed- 
loop  investigations.  All  closed-loop  boundary  avoidance  tracking  parameters  (tmin,  Wx,  Kbm,  and 
BTP)  are  presented  as  functions  of  the  open-loop  parameters  system  time  delay  and  system 
crossover  frequency. 
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igure  G-1: 


Time-to-Boundary  Correlation  with  System  Time  Delay 
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Figure  G-2:  Boundary  Tracking  Feedback  Gain  Correlation  with  System  Time  Delay 
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Figure  G-4:  Time-to-Boundary  Correlation  with  System  Crossover  Frequency 
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5:  Boundary  Tracking  Feedback  Gain  Correlation  with  System  Crossover 
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APPENDIX  H  -  LESSONS  LEARNED 

One  area  of  interest  observed  during  the  analysis  of  figure  1 1  was  that  the  value  of  t^ax 
seemingly  varied  as  a  funetion  of  load  factor.  For  load  factors  greater  than  zero,  Wx  was  seen  as 
significantly  smaller  than  for  load  factors  less  than  zero.  This  relationship  was  not  evaluated 
during  this  project  but  warrants  further  investigation  in  future  boundary  avoidance  projects. 

The  airframe  mounted  camera  must  be  high  resolution  or  hi-definition. 

The  automated  tracking  system  developed  for  HAVE  BAT  was  never  employed  because 
the  resolution  of  the  airframe  mounted  camera  was  insufficient.  The  low  resolution  led  to 
inconsistent  tracking  of  the  video  markings  on  the  target  aircraft  as  well  as  the  total  inability  to 
track  the  slender  T-38  wingtip.  Review  of  hi-definition  video  and  photographs  taken  by 
Edwards  flight  photographers  during  HAVE  BAT’s  final  mission  showed  that  similar  hi- 
definition  camera  systems  would  provide  adequate  resolution  for  the  automated  tracking  system. 

T-2  modification  process 

The  initial  impression  from  the  T-2  modification  shop  for  the  addition  of  the  airframe- 
mounted  camera  (AMC)  was  that  the  addition  of  a  camera  mount  and  integration  into  the 
aircraft’s  existing  recorder  and  power  supply  was  that  it  was  going  to  be  an  extraordinarily 
simple  modification.  The  original  estimate  of  two  days  was  off  by  nearly  12  days  due  to  delays 
within  the  modification  shop  (due  to  manning  issues)  and  complications  integrating  into  the 
aircraft  power  supply.  This  two  week  slip  prevented  some  planned  ground  testing  of  the  AMC. 
Additionally,  USAE  TPS  personnel  were  required  for  the  electromagnetic  interference  and 
compatibility  (EMIC)  testing  of  the  new  camera.  The  modification  shop  does  not  supply  aircrew 
when  EMIC  is  required  and  TPS  had  to  supply  qualified  aircrew  to  conduct  the  testing.  The 
biggest  lesson  learned  was  to  use  the  expertise  within  TPS  to  first  explain  any  delays  in  any 
modification  and  then  to  have  a  plan  to  use  the  school’s  expertise  if  necessary  to  complete  the 
modification. 

Helmet  camera  setup  was  not  ideal  for  task. 

The  first  issue  with  the  helmet  camera  was  one  of  documentation.  The  safety  paperwork 
seemed  to  indicate  that  the  system  existed  and  was  approved  for  use,  but  it  had  fallen  to  the 
wayside  at  the  test  center,  and  nobody  knew  exactly  where  it  was  or  if  it  was  approved  for  use. 
Thanks  to  some  outstanding  work  from  the  AEETC  technical  library,  the  remainder  of  the 
supporting  documentation  for  the  helmet  camera  system  was  located  and  the  camera  was 
approved  for  use.  Next  the  system  had  to  be  found  and  its  operation  deciphered.  The  system 
was  located  a  few  days  before  the  start  of  flight  testing  in  storage  at  412TW/ENPH  (Human 
Eactors)  and  was  borrowed  by  the  test  team.  There  was  not  any  documentation  on  the  operation 
of  the  system,  or  any  corporate  knowledge  on  its  operation  and  it  fell  upon  the  test  team  to  figure 
out  how  to  run  the  system.  The  system  included  a  battery  powered  Hi-8  recorder,  and  a  battery 
powered  video  encoder  contained  in  a  modified  survival  vest.  The  vest  was  described  as  bulky 
and  cumbersome  by  the  pilots.  The  color  camera  was  housed  in  a  mount  that  attached  to  the 
helmet  with  a  hook  and  loop  fastener.  Errors  in  camera  setup  prevented  two  of  the  test  missions 
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from  being  recorded.  Once  the  camera  operation  was  figured  out  by  trial  and  error,  some 
deficiencies  in  its  design  were  discovered.  The  biggest  deficiency  was  there  was  no  way  to 
verify  the  aimpoint  of  the  camera  with  the  system  as  built  until  the  tape  was  replayed.  There 
wasn’t  a  display  on  the  recorder,  and  a  hand  held  recorder  had  to  be  plugged  into  the  system  by  a 
FTE/FTN  to  verify  its  aimpoint  while  on  the  ground.  If  the  pilot  inadvertently  moved  the  camera 
mount  on  the  side  of  the  helmet,  there  would  be  no  way  to  readjust  the  aimpoint  in-flight.  The 
other  issue  was  the  aimpoint  itself  It  was  relatively  easy  to  get  the  azimuth  of  the  camera 
correct,  but  the  test  team  had  repeated  difficulty  getting  the  elevation  of  the  camera  correct.  This 
was  due  to  namely  to  a  lack  of  an  accurate  formation  position  on  the  ground,  but  was  also 
aggravated  by  day  to  day  differences  in  how  the  helmet  was  worn  by  each  pilot.  Without  a 
reliable  spot  to  aim  the  camera  to,  the  aimpoint  was  either  too  low  or  too  high.  If  a  good 
aimpoint  was  found  on  one  flight,  putting  the  camera  in  the  same  location  on  the  helmet  was  not 
a  guarantee  of  a  good  aimpoint  during  a  later  flight  due  to  differences  in  how  the  pilot  wore  his 
helmet  from  flight  to  flight.  The  camera  aiming  issues  could  have  been  alleviated  by  changing 
the  recorder  to  one  with  a  display  that  could  be  safely  opened  on  the  ground  and  in  flight  to 
verify  the  aim  of  the  camera,  and  the  pilot  could  adjust  it  as  required.  A  more  permanent  mount 
once  a  good  aimpoint  was  found  would  be  desirable  as  well.  Another  draw  back  of  the  system 
was  there  was  not  a  way  to  add  an  aircraft  time  stamp  to  the  recording  without  an  additional  T-2 
modification.  The  actual  camera  seemed  to  be  of  sufficient  resolution  for  the  task,  but  the 
inability  to  accurately  aim  the  camera  precluded  it’s  usefulness  as  a  data  collection  tool. 

Develop  a  method  for  determination  of  tminfrom  flight  test  data. 

Ideally,  locating  the  boundary  avoidance  parameters  from  flight  test  data  should  not  rely  on 
a  model  that  attempts  to  predict  those  very  parameters.  The  use  of  Mr.  Gray’s  model  to 
determine  the  boundary  avoidance  tracking  parameters  from  flight  test  data  was  not  the  desired 
solution.  It  was  required,  however,  to  obtain  some  initial  data  from  HAVE  BAT  mission  flights 
to  present  in  the  time  allowed. 

Use  of  verbal  annotation  by  the  test  pilot  during  maneuvering  was  unreliable  and  imprecise 
because  the  delay  between  pilot  perception  to  action  and  finally  the  verbalization  the  thought 
process  was  significant  compared  to  the  dynamic  stick  actuations.  The  use  of  a  triggering  device 
actuated  by  the  pilot  during  flights  could  help  more  easily  identify  when  the  pilot  actually 
switches  from  point  to  boundary  avoidance  tracking. 

Investigate  the  load  factor  dependence  on  tmin  and  tmax^ 

Figure  8  shows  an  initial  analysis  of  a  boundary  avoidance  tracking  event  (20,000  feet  PA, 
250  KIAS,  cruise  configuration).  Of  interest  is  the  difference  seen  in  tmax  for  points  A  and  B. 
Point  A  shows  an  event  where  maximum  aft  stick  was  obtained  in  an  attempt  to  avoid  the 
approaching  upper  boundary  as  the  test  aircraft  sinks  below  the  target  aircraft.  This  tmax  appears 
to  be  approximately  0.5  seconds.  Point  B  shows  an  event  where  maximum  forward  stick  was 
reached  in  attempt  to  avoid  the  approaching  lower  boundary  as  the  test  aircraft  rises  above  the 
target  aircraft.  This  Uax  value  appears  to  be  approximately  1.8  seconds. 

Since  aft  stick  provides  for  load  factors  greater  than  one  and  forward  stick  provides  for 
load  factors  less  than  one,  it  initially  appears  that  there  is  some  load  factor  dependence  on  the 
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time-to-boundary  parameters.  Whether  this  is  a  result  of  the  pilot  self-limiting  his  inputs  based 
on  aircraft  limits  (an  unstated,  unanalyzed  boundary  during  this  project)  or  an  innate  sense 
ingrained  in  the  pilot  is  unknown,  but  the  initial  review  of  the  data  shows  potentially  some  sort  of 
relationship  between  time-to-boundary  and  load  factor.  This  relationship  should  be  investigated 
further  as  it  could  have  an  effect  on  the  development  of  boundary  avoidance  tracking  flight  test 
techniques. 
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APPENDIX  I  -  LIST  OF  ABBREVIATIONS,  ACRONYMS,  AND 
SYMBOLS 


AFB 

AFI 

AFIT 

AFRL 

APU 

BTP 

CA 

COMSEC 

DAS 

Db 

DoD 

DSN 

DTC 

FAA 

FCC 

FLTS 

HUD 

lAW 

Kbm 

MOP 

N/A 

OPSEC 

PAR 

PCMCIA 

PEPS 

rb 

RTO 

SRB 

TAP 

TDY 


TMP 

tb 

TPS 

USAE 

VMC 

CO180 


:  Air  Eorce  Base 
:  Air  Eorce  Instruction 
:  Air  Eorce  Institute  of  Technology 
Air  Eorce  Research  Eaboratory 
:  Auxiliary  Power  Unit 
Boundary  Tracking  Parameter 
:  California 

:  Communications  Security 
:  Data  Acquisition  System 
:  Distance  to  boundary 
:  Department  of  Defense 
;  Defense  Switching  Network 
:  Data  Transfer  Card 
:  Eederal  Aviation  Administration 
:  Eederal  Communications  Commission 
:  Elight  Test  Squadron 
:  Head  Up  Display 
:  In  Accordance  With 

:  Boundary  avoidance  tracking  feedback  gain 
:  Measure  Of  Performance 
:  Non  Applicable 
:  Operation  Security 
:  Program  Assessment  Review 

:  Personal  Computer  Memory  Card  International  Association 
:  PreElight  Planning  System 
:  Rate  to  boundary 
:  Responsible  Test  Organization 
:  Safety  Review  Board 
:  Test  Assessment  Panel 
:  Temporary  Duty 

;  Time  to  boundary  for  maximum  pilot  feedback  (seconds) 

:  Time  to  boundary  for  minimal  pilot  feedback  (seconds) 

:  Test  Management  Project 
:  time-to-boundary 
:  Test  Pilot  School 
:  United  States  Air  Eorce 
:  Visual  Meteorological  Conditions 
:  System  crossover  frequency  (Hertz) 
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